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Abstract 



This white paper describes how the Ethernet network signals are routed through the ProLiant BL p- 
Class system components and provides an overview of the patch panel and Ethernet switch 
interconnect options for connecting the network signals to the external network infrastructure. For more 
information about the interconnect switch options, see the ProLiant BLp-ClassGbE Interconnect 
Overview white paper 1 and the ProLiant BLp-C lass GbE2 Interconnect Switch Overview white paper 2 . 

The intended audience for this paper includes engineers and system administrators familiar with the 
HP ProLiant BL p-Class system. For readers notfamiliar with the HP ProLiant BL p-Class system, more 
information is available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ platforms/ index-bl.html . 

Introduction 

The ProLiant BL p-Class system includes industry-standard server blades, a rack-mountable server 
blade enclosure, and four interconnect options. The high-performance ProLiant BL p-Class server 
blades are designed for use in multi-tiered environments. The 2 -way ProLiant BL2 Op and BL2 0 p G 2 
server blades are ideal for mid-tier applications, and the 4-way ProLiant BL40 p server blade is ideal 
for back-end applications. These server blades contain multiple embedded network interface 
controllers (N ICs) 3 . 

The BL p-Class enclosure holds up to eight 2-way or two 4-way server blades (or a combination of 
both) and two interconnects. The enclosure has a signal backplane that routes Ethernet signals from 
the server blade N ICs to the interconnects in a redundant, highly available architecture. 

HP offers four interconnect options, including two G igabit Ethernet (G bE) interconnect switch options 
for network cable consolidation and two patch panel options for Ethernet signal pass-through to third- 
party LAN devices. 

This white paper: 

• Identifies the N ICs available with each ProLiant BL p-Class server blade 

• Describes how the Ethernet network signals are routed through the p-Class serve blade enclosure 

• Provides a decision chart to help customers choose the appropriate interconnect option 

• Provides an overview of each interconnect option 

ProLiant BL p-Class server N ICs 

The ProLiant BL p-class server blades include multiple general-purpose ProLiant N C series N ICs and 
one additional N IC dedicated to Remote Insight Lights-out M anagement (iLO ). Table 1 identifies the 
type and number of embedded N ICs available with each ProLiant BL p-Class server blade. 

Table 1. ProUant BL p-Class server blade N ICs 



ProLiant BL p-Class 


NC3163 


NC7780 


NC7781 


iLO 


Total 


server blade 


10/ 100 


10/ 100/ 1000 


10/ 100/ 1000 


10/ 100 


NICs 


BL20p 


3 


0 


0 


1 


4 


BL20p with NC7780 Upgrade 


1 


2 


0 


1 


4 


BL20p G2 


0 


0 


3 


1 


4 


BL40p 


0 


0 


5 


1 


6 



1 Available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ pro li a nt-bl/ p-class/ bl-p-interconnect-switch.html . 

2 Available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p-interconnect-switch2.html . 

3 An embedded NIC integrates the Ethernet capabilities directly onto the system board to eliminate using an I/O slot for Ethernet connectivity. 
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Each ProLiant N C series N IC has been designed, developed, and manufactured to meet the needs of 
ProLiant customers. HP's testing, certification, and validation of NICs within ProLiant servers further 
enhance this value. Additionally, the N C series N ICs provide the following features: 

• Preboot execution Environment (PXE) and W ake on LAN (W 0 L) capability 

• High-availability teaming including Network Fault Tolerance (N FT), Transmit Load Balancing (TLB), 
and Switch-assisted Load Balancing (SLB) 

• Teaming Configuration G Ul for M icrosoft® operating systems 

• Auto-negotiation for speed and duplex 

• Support for management agents and sophisticated management tools such as Insight M anager 7 

• TCP Checksum and segmentation offload to reduce the load on the CPU for overall improved 
system response (N C7780 and N C7781) 

ProLiant BLp-C lass server blade enclosure 

The ProLiant BL p-Class server blade enclosure is a 6U (10.5-inch) chassis with two outside 
interconnect bays and eight interior server bays that support various combinations of ProLiant BL p- 
Class server blades (Figure 2). The bays are designed so that the server blades and interconnect 
blades slide in and blind mate to the server blade enclosure backplane for power and data 
connections. The signal backplane routes both Ethernet and Fibre Channel signals from the server 
bays to the interconnect bays while completely isolating these signals from each other. 



Figure 2. ProLiant BL p-C lass server blade enclosure 



Signal backplane 



Interconnect 
bay A 




Server blade bays 



Blade enclosure network signal routing 

Each server bay supports up to four Ethernet signals. This is sufficient for the BL2 0 p and BL2 0 p G 2 
server blades with four N ICs each, and it is ample for the BL40p server blade, which has six N ICs 
spread over four server bays. 

Figure 3 illustrates the network signal routing from a single server blade bay to the interconnect bays. 
Individual category 5e specified signal traces on the passive backplane route the network signals as 
Ethernet from the server blade N ICs to the interconnect bays. To provide redundant network 
connections and maximize network availability, half of the network signals from each server blade 
bay go to each interconnect bay, regardless of the slot width of the server blade or the number of 
N ICs it supports. 
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Figure 3. The server blade enclosure backplane routes Ethernet signals from each server blade bay to both interconnect bays. 




Interconnect 
buy B 



The network signal routing from the N ICs in each ProLiant BL p-Class server blade to the interconnect 
bays is provided in Table 2. 



Table 2. ProLiant BL p-C lass server blade N IC signal routing 





Interconnect bay A (left) 


Interconnect bay B (right) 


BL20p 


2x NC3163 


lx NC3163, lx iLO 


BL20p with 
NC7780 Upgrade 


lx NC3163, lx NC7780 


lx NC7780, lx iLO 


BL20p G2 


2x NC7781 


lx NC7781, lx iLO 


BL40p 


3x NC7781 


2x NC7781, lx iLO 



PXE 

Each N C series N IC on the ProLiant BL servers supports PXE, but only one N IC at a time may be PXE 
enabled. A N IC on each server is pre-selected as the default PXE N IC . This results in all the PXE 
enabled N ICs being routed to the same interconnect. However, the RO M Based Setup Utility (RBSU) 
for ProLiant BL servers may be used to select any N IC. Thus, system availability can be enhanced by 
selecting PXE-enabled N ICs that are routed to different interconnect blades. 
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ProLiant BL p-C lass interconnects 



All network signals from the server bays are routed to the interconnect bays. HP offers four ProLiant BL 
p-C lass interconnect options that allow customers to choose how the networking and storage signals 
exit the server blade enclosure. These interconnect options include two ProLiant RJ45 patch panel kits 
and two ProLiant GbE interconnect kits. 

The two patch panel kits provide pass-through of network signals (RJ45 Patch Panel Kit) or network 
and storage signals (RJ-45 Patch Panel 2 Kit), thus giving customers the flexibility to choose the 
switches they prefer. Alternatively, the two G bE interconnect kit options provide different levels of 
Ethernet switching functionality and Fibre Channel signal pass-through. In general, customers should 
choose the appropriate interconnect option based on the following criteria: 

• The RJ45 Patch Panel Kit provides Ethernet signal pass-through only. 

• The RJ45 Patch Panel 2 Kit provides both Ethernet and BL20p G2 Fibre Channel signal pass- 
through. 

• The G bE Interconnect Kit consolidates 100 M bps Fast Ethernet N IC signals. 

• The G bE2 Interconnect Kit provides consolidation of 1000 M bps G igabit Ethernet N IC signals, 
advanced network capabilities, and BL20p G 2 Fibre Channel signal pass-through. 

Figure 4 contains an interconnect decision chart to assist customers in choosing the specific 
interconnect kit and its orderable part number. 



Figure 4. Interconnect decision chart 
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Each interconnect kit includes two interconnects for one server blade enclosure. Each interconnect 
itself consists of two hot-pluggable components, a front loading interconnect blade and a rear 
mounted interconnect module that contains the network connectors. This modular design provides two 
key benefits: 

• The interconnect blade can be quickly and easily removed and replaced from the front of the rack 
without the need for re-cabling. 

• Interconnect switch can support copper or fiber Ethernet network uplinks by using different 
interconnect modules. This design also allows the uplinks to be easily upgraded to future 
technology. 



RJ45 Patch Panel and RJ45 Patch Panel 2 Kits 

The RJ-45 Patch Panel and RJ45 Patch Panel 2 Kits each contain two patch panel interconnect blades 
that allow Ethernet LAN signals to pass through to third-party LAN devices, thus giving customers 
flexibility in choosing their own network switch, hub, or router. Both the RJ45 Patch Panel and RJ45 
Patch Panel 2 Kits bring all 32 Ethernet signals out as separate RJ45 connections through two rear- 
mounted LAN interconnect modules per patch panel device. Both kits support the BL2 0 p and BL2 0 p 
G 2 server blades (shown in Figure 5), the BL40p server blade, or a combination of these servers. 

In addition to Ethernet signal pass-though, the RJ-45 Patch Panel 2 Kit provides 16 Fibre Channel front 
panel ports to support signal pass-through for up to eight ProLiant BL2 0 p G 2 servers with two Fibre 
Channel ports each 4 . The ProLiant BL40p server blade does not require Fibre Channel signals to be 
routed to the interconnect bays. 



Figure 5. RJ45 Patch Panel and RJ45 Patch Panel 2 pass-through Ethernet signal routing with BL20p or BL20p G2 servers 




RJ-45 Patch Panel or 
RJ-45 Patch Panel 2 

* The BL40p server blade h also supported. (Interconnect bay B) 



4 For more information, see the ProLiant BLp-Class SAN Storage Connectivity white paper at 
http://h71025.www7.hp.com/support/ reference library/ viewdocument.asp?countrycode=1000&prodid=5 72 6| ProLia nt+BL+p- 
Class+System&source=TC030803TB.xml&dt=21&docid=20366 . 
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W hether using the RJ45 Patch Panel or RJ45 Patch Panel 2 Kit, each RJ45 connector corresponds to 
a specific embedded N IC in each server blade. A ProLiant BL2 0 p or BL2 0 p G 2 server blade installed 
in the server bay 1 occupies the bottom row of connectors (Figure 6). Each consecutive server blade 
occupies the next highest row of connectors. 



Figure 6. RJ45 Patch Panel Kit and RJ45 Patch Panel 2 Kit network connections for ProLiant BL20p and BL20p G2 server 
blades 
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The RJ45 Patch Panel and RJ45 Patch Panel 2 Kit network connections for two ProLiant BL40 p server 
blades installed in the p-C lass server blade enclosure are shown in Figure 7. 



Figure 7. RJ45 Patch Panel Kit and RJ45 Patch Panel 2 Kit network connections for ProLiant BL40p server blades 
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ProLiant GbE Interconnect Kit 



The ProLiant BL p-C lass server enclosure provides eight server blade bays, each supporting up to four 
Ethernet network adapters. Therefore, a fully configured server blade enclosure can have up to 32 
Ethernet cables, and a 42 U rack fully configured with BL p-C lass server blades can have up to 192 
Ethernet cables. As a result, the number of Ethernet network cables within this space can quickly 
become overwhelming. 

For applications that require network cable reduction, the ProLiant G bE Interconnect Kit consolidates 
the server blade network adapter signals to 100 M b/ s (Fast Ethernet) using two Ethernet switches 
mounted into the server blade enclosure. The G bE Interconnect Kit includes two hot-swappable, fully 
managed layer 2 Ethernet switches and two rear-mounted, 4-portLAN interconnect modules (Figure 
8). The G bE Interconnect Kit is available in two options: the C-G bE Interconnect Kit for copper-based 
networks and the F-G bE Interconnect Kit for fiber-based networks. The difference between the kits is 
the LAN interconnect module that supports the uplink port media. The C-G bE Interconnect kit includes 
two Q uadT interconnect modules, each with two 10/ 100/ 1000T and two 10/ 100T ports, all with RJ- 
45 connectors. The F-G bE Interconnect Kit includes two DualTSX interconnect modules, each with two 
1000SX ports with LC connectors and two 10/ 100T ports with RJ-45 connectors. 

Each G bE Interconnect Switch reduces up to sixteen internal server blade network N ICs ports to six 
external Ethernet ports: four ports on the rear-mounted LAN interconnect module and two ports on the 
switch front panel. The front panel ports are for local switch access, port mirroring, or additional 
uplinks to the network. Because each external Ethernet port can communicate to all the server blades, 
one to twelve external ports (per enclosure) may be used to connect to the network infrastructure. 



Figure 8. ProUant BL p-C lass GbE Interconnect Switch front panel and rear view 
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The two G bE Interconnect Switches are connected across the server blade enclosure backplane 
through a pair of redundant 10/ 100 Ethernet crosslinks bundled into a multi-port EtherC ha nnel 
compatible trunk (see Figure 9). These crosslinks permit communication between the switches for 
additional management capability, fault tolerance, and cable reduction. As a result, any single uplink 
port may be used to connect to all 32 N ICs for a 32-to-l network cable reduction. 



Figure 9. ProUant BL p-C lass G bE Interconnect Kit architecture 




*The ProLiant GbE Interconnect Switch GbE Interconnect Switch 

oho supports the &L40p server blade. j| nterconnect ^ 



The redundant architecture of the GbE Interconnect Kit allows system administrators to configure the 
Ethernet network for continued access to each server blade in case of the following failures: 

• Interconnect switch failure 

• Switch failure within the Ethernet network backbone 

• Server blade network adapter failure 

• Server blade N IC-to-interconnect switch port failure or connection failure 

• Uplink port and uplink port connection or cable failure 

• Interconnect switch crosslink port or connection failure 

• Power or fan failure 

For more information, see the ProLiant BLp-Class GbE Interconnect Kit Overview white paper. 5 



5 Available at http:/ / hl8004.wwwl.hp.coin/ products/ servers/ prolia nt-bl/ p-class/ bl-p-interconnect-sw itch .html , 
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ProLiant GbE2 Interconnect Kit 



The second generation ProLiant GbE2 Interconnect Kit is also designed to significantly reduce the 
number of Ethernet network cables attached to the rear of the server blade enclosure. However, it is 
designed for applications that require network adapter consolidation to 1000 M b/ s (G igabit 
Ethernet), advanced network functionality, future upgradea bility including layer 3-7 switching and 10 
G igabit Ethernet uplink bandwidth, and BL2 0 p G 2 Fibre Channel signal pass-through. 

The G bE2 Interconnect Kit contains two hot-swappable, fully managed layer 2 G bE2 Interconnect 
Switches and two LAN interconnect modules (Figure 10). Like the first generation G bE Interconnect 
Kit, the G bE2 Interconnect Kit is available for copper-based (C-G bE2) and fiber-based (F-G bE2) 
networks. These interconnect kits are identical with exception of the interconnect modules. The 
C-G bE2 Interconnect kit includes two Q uadT2 interconnect modules, each with four 10/ 100/ 1000T 
ports with RJ45 connectors. The F-G bE2 Interconnect Kit includes two Q uadSX interconnect modules, 
each with four 1000SX ports with LC connectors. 



Figure 10. ProUant BL p-C lass G bE2 Interconnect Switch front panel and rear view 
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In addition to providing a 32 to 1 server networking cable reduction per server enclosure like the 
G bE Interconnect Kit, the G bE2 Interconnect Kit offers the following features: 

• All switch ports provide G igabit Ethernet performance to support applications that require network 
adapter consolidation to 1000 M b/ s. Each G bE2 Kit provides 24 G b/ s full duplex external port 
(uplink) bandwidth per server blade enclosure. 

• A multi-port 10-G b/ s fabric standard on each G bE2 Interconnect Switch supporting future layer 3-7 
IP load balancing option and 10 G igabit Ethernet uplink upgradea bility (Figure 11). The switching 
layer and the uplink bandwidth can be independently selected within a single switch offering. 

• Advanced network feature support and system availability including spanning tree per VLAN , 9k 
jumbo frames, RADIUS, redundant syslog servers, redundant operating system firmware images and 
configuration files in memory, and more. 
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• 0 ptional pass-through of ProLiant BL2 0 p G 2 Fibre Channel storage signals using the G bE2 Storage 
Connectivity Kit. Therefore, both Ethernet signal consolidation and Fibre Channel pass-through is 
now possible using a single interconnect (see the ProLiant BLp-Class SAN Connectivity technology 
brief 6 . 



Figure 11. ProUant BL p-C lass G bE2 Interconnect Kit architecture 




*The FroUouf GbE2 Interconnect Switch GbE2 Interconnect 
also supports the BlAQp server blade. Switch B 



For more information, see the ProLiant BLp-Class GbE2 Interconnect Switch Overview white paper 7 . 

Investment protection 

The ProLiant BL p-C lass interconnects are designed to support any mix of ProLiant servers. W ithin the 
p-C lass server blade enclosure, many different configurations of 2-processor and 4-processor server 
are possible. For example, configurations may exist with only ProLiant BL2 0 p or BL20p G 2 servers, a 
mix of ProLiant BL20p and BL20p G 2 servers, only BL40p servers, or a mix of BL40p, BL20p, and 
BL20p G 2 server blades. 

Conclusion 

The networking design of the ProLiant BL p-C lass provides maximum flexibility and significant 
performance in an end-to-end redundant architecture. The minimum four network adapters included as 
standard with each server are routed to a pair of fully redundant, hot swappable interconnects. HP 
offers a wide selection of interconnect kits for a choice of network cable consolidation and Fibre 
Channel signal pass-through. The patch panel kits allow a user to select the network switches or other 
components of their preference. The interconnect switches are ideal for reducing Ethernet network 
cabling and the time required to deploy, manage, and service ProLiant BL p-C lass systems. 



6 Available at http:/ / h71025.www7.hp.coin/ support/ reference library/ viewdocument.asp?countrycode=1000&prodid=5 726| ProLia nt+BL+p- 
Class+System&source=TC030803TB.xml&dt=21&docid=2 0366 . 

7 Available at http:/ / hl8004.wwwl.hp.com/ products/ servers/ prolia nt-bl/ p-class/ bl-p-interconnect-switch2.html . 
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For more information 



For additional information, refer to the resources detailed below. 



Resource description 


Web address 
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